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EXCITED RANDOM WALKS WITH NON-NEAREST NEIGHBOR STEPS 


BURGESS DAVIS AND JONATHON PETERSON 


Abstract. Let W be an integer valued random variable satisfying E\W\ =: J > 0 and P{W < 
0) > 0, and consider a self-interacting random walk that behaves like a simple symmetric random 
walk with the exception that on the first visit to any integer x £ X the size of the next step is an 
independent random variable with the same distribution as W. We show that this self-interacting 
random walk is recurrent if <5 < 1 and transient if J > 1. This is a special case of our main result 
which concerns the recurrence and transience of excited random walks (or cookie random walks) 
with non-nearest neighbor jumps. 


1. Introduction and statement of main results 

This paper concerns the study of one-dimensional excited random walks with possibly non- 
nearest neighbor jumps. Excited random walks (also called cookie random walks) are a model for 
self-interacting random motion where the transition probabilities are a function of the local time of 
the walk at the present location. While self-interacting random walks are typically very difficult to 
study, much is known about one-dimensional nearest neighbor excited random walks. Under mild 
assumptions there are explicit criteria for recurrence/transience, ballisticity, and a characterization 
of the limiting distributions of the excited random walks [ZerOht IBSOHat IBSn8b( IKZOSt IKMllj . In 
the current paper, we study a model for excited random walks that allows for jumps that can even 
be unbounded. We will prove a simple criterion for recurrence/transience of the excited random 
walk that generalizes the known results for nearest neighbor excited random walks. 

There has been some limited study of excited random walks with bounded jumps in dimensions 
d > 2. The model that we discuss below is inspired in large measure by the generalized excited 
random walk introduced in [MPRV 1^ . However, the methods developed in [MPRVl^ were limited 
to d > 2, and the behavior of nearest neighbor excited random walks is very different in dimensions 
larger than one. In particular, multi-dimensional excited random walks with local drifts contained 
in a fixed half-plane are known to be transient with a non-zero limiting speed and CLT type limiting 
distributions [BR.OTl IMPRV 12] . In contrast, for one-dimensional excited random walks it is known 
that the walks can be transient with sublinear speed and with non-Gaussian limiting distributions 
|BSn8a[lBM^IKMll| . 

1.1. Excited random walks with non-nearest neighbor jumps. We will describe the model 
of excited random walks with non-nearest neighbor jumps using the terminology of cookie environ¬ 
ment^ introduced by Zerner in |Zer05| . Let Mi (Z) denote the space of probability distributions 
on Z. A cookie environment is an element 

a; = G =: H. 

Given a cookie environment cj, we will construct a random walk {Xn}n>o as follows. For each x € Z 
and j > 1, ujx^j = {uJx^j{z))z£'E will determine the step distribution for the random walk upon the 
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j-th. visit to the site x. More specifically, given any x € Z and w € n, the excited random walk in 
the cookie environment oo started at x is a stochastic process {Xn}n>o with distribution given 
by PSi^o = x) = 1 and 


(1) P^{Xn+i = Xn +z\a{Xk, k <n)) =uJx„,Lr,{Xr,)i^), where L„(y) = ^ 

k=0 


In general, we will allow the cookie environments oj to be chosen from a measure r] on the space 
of cookie environments kl. That is, using the notation Ux = {uJx,j}j>i for the cookie environment at 
the site x G Z, we will assume that {uJx}x€'E is a stationary and ergodic sequence of Mi(Z)^-valued 
random variables under the measure rj. For a fixed cookie environment, the measure P^ is called 
the quenched distribution of the random walk. If we then average the quenched distribution over 
all environments according to the measure rj we obtain the averaged distribution of the random 
walk P^(') = Erj[P^{-)], where Erj denotes expectation with respect to the measure r] on cookie 
environments. We note that often we will be interested in the excited random walk starting at 
Xq = 0 in which case we will use the notation P^^ and in place of P^ and P^. Expectations with 
respect to and P^ will be denoted by E^ and respectively, where again the superscript x 
will be omitted when x = 0. 

For one-dimensional nearest neighbor excited random walks, much of the qualitative behavior 
of the random walk is determined by a single parameter: the expected total drift of the cookies 
environment at a site. That is, if d(/r) = Ylz denotes the mean of the distribution /r G Mi(Z) 

(assuming the mean is finite) then the expected total drift of the cookie environment at a site is 


( 2 ) 


S = 5{r]) := En 



— Exj 

UJO,j{z) 



j>l Z&i 


Naturally, for the model as currently stated there is no guarantee that the expectation on the right 
side of (121) exists. Note that in the case of nearest neighbor excited random walks the formula for 
5 simplifies to d = E'r;[X^j>i(2wo,j(l) — 1)], and thus the parameter 5 is well defined if the measure 
rj is restricted to cookie environments with one of the following properties. 

• uixj{l) > 1/2 for all x G Z, j > I. 

• There exists an M < oo such that ujx,ji^) = 1/2 for all x G Z, j > M. 

These properties are commonly referred to as the case of non-negative cookies and finitely many 
cookies per site, respectively. In either of these cases, it is known that the parameter 6 determines 
the recurrence/transience of the excited random walk [Zern5( IKZ08] . That is, the excited random 
walk is recurrent if 6 G [—1,1], transient to the right if 5 > I and transient to the left if 5 < — 1. 
Moreover, in the case of finitely many cookies per site, the parameter <5 gives a criterion for when 
the limiting speed of the excited random walk is non-zero |BS08a[ IKZ08] and also determines the 
limiting distribution for the excited random walk |BS08bl IKMlll IKZ081 IDK12| . 

To prepare for our main results, we first need to provide some assumptions on the measure p 
on cookie environments which will ensure the parameter 5 in ([2]) is well defined. To this end, let 
Mq = {/r G Mi(Z) : d{pL) = 0} be the subset of probability measures on Z with zero mean, and let 
= {/r G Mi(Z) : d{yL) G [0,oo)} be the subset of probability measures on Z with non-negative 
finite mean. We will assume that our cookie environments oj belong to a fixed subset C fl 

defined by 

^ W)^ M > 1, /r G Xo. 

That is, cj G only if d{ojx,j) > 0 for all x G Z, j < M and Uxj = fJ- for all x G Z and 

j > M. 
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Remark 1.1. The terminology of “cookie environments” is helpful in describing the walk in the 
following way. For any uj G ^~m fi imagines a stack of M cookies at each site x, where the 

j-th cookie in the stack corresponds to the distribution Ux,j G Mi(Z). When the random walker 
reaches a site x for the j-th time with j < M, the walker consumes the j-th cookie in the stack 
which “excites” the walker by inducing a jump probability of C0x,j with non-negative drift for the 
next step. If the walker ever visits a site x more than M times then on every visit after the M-th 
visit there are no cookies remaining at that site to excite the walker and so the next step is chosen 
according to the fixed distribution /r with zero mean. 

Throughout the paper we will make the following assumption for the distribution t] on cookie 
environments. 


Assumption A. The measure rj on cookie environments is such that {u}x}xe'E is stationary and 
ergodic and r]{u G = 1 for some fixed M > 1 and /i G Alo\{<5o}- 

Assumption B. The distribution yL in Assumptionf^is such that 

• p,{[—B,B]) = 1 for some B < oo, and 

• the span of supp is 1. That is, the random walk with step distribution p is aperiodic. 


Assumption C. With M > 1 as in Assumption\^ the distribution ij is such that 


(3) 


Ert 


M 


EEi 

j=lz£Z 


I ^o,j ( 


< oo. 


Remark 1.2. Assumptions lAHO are rather mild. The main restriction we are making is that p is 
concentrated on that is, M cookies per site and all cookies induce a non-negative drift. The 

requirements that p have hnite support and the expectation in ([3]) is finite are technical conditions 
needed for our proofs, though it is not clear if a different proof could remove these restrictions. The 
other conditions in Assumptions lAHCl are used to avoid obvious degeneracies. For instance without 
the aperiodicity condition on p in Assumption iBl our characterization of recurrence/transience by 
5 in Theorem [Lbl below is no longer true. Indeed, one can trivially modify a cookie environment 
satisfying the assumptions in this paper in such a way that the random walk is concentrated on 2Z 
without changing the recurrence/transience of the walk but so that the value of 5 is doubled. 


Remark 1.3. Note that ([3]) in Assumption ICl implies that the parameter 5 as defined in ([2]) is finite. 
However, the converse is not true. For instance, suppose that M = 1 and that the distribution p 
on cookie environments is such that the jump distribution of the walk on the first visit to x G Z is 
given by 


Wx,l(z) 


1/2 if \z\ = Kx 
0 otherwise, 


where {Kx}x£i, is an i.i.d. sequence of non-negative integer valued random variables. Then, clearly 
dio}x,i) = 0 almost surely, but the expectation in ([3]) is equal to E^jlKo] which may be infinite. 


Let TZ, 7+ and T- be the events defined by 


= < X] = oo, Vx G Z 


n>0 


and 7± = { lim A^n = Too}. 

n—>-oo 


That is, TZ is the event that the random walk is recurrent and 7+ (or 7L) is the event that the 
random walk is transient to the right (or left). Since we have assumed that all cookies induce a 
non-negative drift, it is natural to expect that the walk is either recurrent or transient to the right. 
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Indeed, our first main result shows that this is the case and also gives a sufficient condition for the 
walk to be recurrent. 


Theorem 1.4. Let Assumvtions l^W^ hold. Then, 

(i) p^(7^ur+) = l. 

(ii) Moreover, if 6 < 1 then Pr,(7^) = 1. 

Theorem oi gives a sufficient condition for recurrence in terms of the parameter 5. To improve 
this to a complete characterization of recurrence/transience in terms of the value of <5 we will need 
a few more assumptions on the distribution r] on cookie environments. 


Assumption D. The sequence {coxfxez is i.i.d. under the measure rj. 


Assumption E. r/(a;o,i([l, oo)) > 0) 


1 and Eri 


ni=i Ylz<o^o,j{z) 


> 0 . 


Remark 1.5. If Assumption |D] is satisfied we will say that the cookie environment is spatially i.i.d. 
Assumption [E] is a weak ellipticity assumption with the following probabilistic interpretation: the 
random walk always has a positive probability of jumping to the right on the first visit to a site 
and there is a positive probability that all M of the cookies at a given site allow for jumps that 
are non-positive. Note that since /z is a non-degenerate distribution with zero mean, it follows that 
—1]) > 0 so that whenever there are no cookies remaining at a site the walk has a positive 
probability of stepping to the left. 


Our other main result extends the characterization for recurrence/transience of nearest neighbor 
excited random walks to non-nearest neighbor excited random walks satisfying the above assump¬ 
tions. 


Theorem 1.6. Let Assumvtions [AHEI hold. Then, 

(i) P^(7^) = 1 ^ 5 < 1. 

(ii) P^(r+) = 1 ^ 5 > 1. 

Remark 1.7. A characterization of recurrence/transience of nearest neighbor excited random walks 
was proved by Zerner in |Zer05| under conditions corresponding only to Assumptions lAHCl We 
note that in the present paper Assumptions [D] and [E] are only needed in the proof of Theorem 11.61 
to prove the 0-1 law for recurrence/transience in Section [5l For nearest neighbor one-dimensional 
excited random walks this 0-1 law is known to hold for ergodic cookie environments [ABOlOj . and 
thus we conjecture that Theorem 11.61 can be extended to ergodic cookie environments (possibly 
under some additional ellipticity assumptions). 

As noted above, for nearest neighbor excited random walks many other aspects of the random 
walk are characterized by the parameter 5. We conjecture that (under appropriate assumptions) 
these results can be extended to excited random walks with non-nearest neighbor jumps. In par¬ 
ticular, we mention the following conjecture. 

Conjecture 1.8. Under Assumptions rAVTS there exists a deterministic constant vq G [0,oo) such 
that 

lim —- = Vo, P„-a.s. 

n^oo Tl 

Moreover, vq > H if and only if 6 > 2. 

Some partial progress regarding Conjecture 11.81 is already underway, and we hope to address this 
more fully in a future paper. 

The structure of the remainder of the paper follows closely the general framework of Zerner in 
[Zer06| in which he proved a criteria for recurrence/transience of nearest neighbor excited random 
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walks on or on a strip Z x {0,1,... , L — 1} C 1?. One can map the strip Z x {0,1,... , L — 1} 
bijectively to Z by (x, y) i—)• Lx + y, and thus any excited random walk on a strip can be interpreted 
as an excited random walk on Z with uniformly bounded jumps. However, since the vertices at the 
“top” and “bottom” of the strip are somewhat different than the other vertices in the strip, even if 
one assumes a spatially i.i.d. cookie environment on the strip the corresponding cookie environment 
on Z is no longer spatially ergodic. Thus, the results in [Zer06] do not directly apply to our setup. 
Most (but not all) of the arguments in |Zer06| can be easily modified, however, to cover excited 
random walks on Z with uniformly bounded jumps. Thus, the main novelty of the results in the 
current paper is that we allow for cookies to induce jump distributions with unbounded support. 
This introduces serious technical difficulties at several places in Zerner’s argument. We mention in 
particular the following. 

• The proof that P^(limsup„_^QQ = oo) = 1 follows easily from a martingale argument 
in [ZerOBI . However, the argument in |Zerf)6| is no longer true for excited random walks 
with possibly unbounded jumps (see Remark 1,3.21 below) and so a new argument is needed. 

• The proof of the existence of a stationary distribution for the cookie environment (Section 
0] below) is significantly more difficult than in |Zer06| . Since we are allowing for unbounded 
jumps the space of cookie environments is non-compact, and certain tightness results which 
follow immediately in |Zer06| must be proved more directly in this paper (see Lemma 14.31 
below). 

We also mention that even in the case of excited random walks with uniformly bounded jumps, the 
0-1 laws in Section [5] are much more difficult than in [ZerOOl since our weak ellipticity condition in 
Assumption |E] is much weaker than the uniform ellipticity assumption in [ZerOhj . 

The outline of the paper is as follows. In Section [2] we describe a basic martingale estimate 
due to Zerner that will be the basis for much of our analysis. Theorem 11.41 is then proved in 
Section [3l where we note that a technical difficulty is proving that lim inf„_j.oo = —oo and 
lim sup„_^oo Xn = oo imply that every site is visited infinitely often. In Section |4] we introduce 
the “cookie environment process” which is analagous to the environment viewed from the point of 
view of the particle in random walks in random environments. The main result in Section [4] is the 
existence of a stationary measure for the cookie environment process with certain nice properties. 
In Section [5] we prove a 0-1 law for recurrence/transience under the additional Assumptions iDl and 
[El and finally in Section [6] we use the cookie environment process and the 0-1 law to prove the 
sharp criterion for recurrence/transience from Theorem 11.61 

2. Notation and Preliminary estimates 

We begin by introducing some notation that will be used throughout the paper. For any x G Z, 
let Tx and ax be the first time the random walk goes above or below x, respectively. That is, 

Tx = inf{n > 0 : A„ > x}, and ax = inf{n > 0 : < x}. 

Next, since the transitions of the excited random walk depend on the past history of the walk, we 
need some notation to keep track of this information. Define a function a : H x Z^ ^ H by 

Oi{oj^€)x,j ^x,i(x)+j 1 ^ ^ 3 — f' 

That is, is the cookie environment oj modified by removing the first i{x) cookies from site 

X for each x G Z. 

Definition 1. The function a dehned above gives a natural partial ordering on We say that 

cj' < cj if there exists an £ G Z^ such that oo' = a{u},£). (Note that the fact that this defines a 
partial ordering on relies on the fact that u)xj{-) = y{-) for all x G Z, j > M.) 
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Definition 2. The process {w(n)}„>o is defined by w(0) = w and uj{n) = a{uj,Ln-i) for n > 1, 
where Ln-i = {Ln-i{x)}x&’L as defined as in ([T]) is the local time of the walk after n — 1 steps. 
That is, uj{n) is the cookie environment remaining just before the walk makes the n-th step. 

2.1. A martingale argument. The key to the proofs of the main results in the present paper 
is the adaptation of a martingale argument that was first introduced by Zerner in |Zer05] . For 
cj G and x G Z, let d{ujx) = be the total drift contained in the cookies at x. 

Also, for X G Z and n > 1 let d{oJx,j) be the the total drift the excited random walk 

has “consumed” at site x in the first n — 1 steps. Then is the total drift consumed 

by the excited random walk by time n. Then is a martingale under the quenched 

measure P* with respect to the natural filtration Xn = : k < n). The optional stopping 

theorem implies that for any cookie environment oj G ^ and integers x < y < z that 

2-1 

(4) = y + El <y+ 

k=x-\-l 

To justify the application of the optional stopping theorem, it is enough to prove that 

(5) E'^[tz hax] < oo 
and 

(6) El[\Xt+i - At I I Pi] < C < oo, for all t < A ax- 

The expectation in ([5|) is finite for any fixed x,y,z and io G ^ since the exit time of any fixed 
interval has exponentially decaying tails due to the fact that there are only M cookies at each site. 
The uniform upper bound in ([6]) holds with C = maxf^^(^x,z) maXj<M j^j < oo. 

In addition to the martingale estimate in (jH), we will also need the following minor modification. 

Lemma 2.1. Let be the total drift used to the right of the origin by time n. If the 

cookie environment oj is such that 

• ojx = {^x,j}j>i S X {/i}^ for all X > 0 

• (lim sup„_^oo A„ = oo) = 1 for all x > 0 

then 

(7) EZlDtJ <n + EZ [(A,„ - n)l{x._i>o}] , Vx G [0, n). 

Remark 2.2. We note that the conditions on the environment in Lemma l2.ll are slightly weaker 
than assuming uj G Indeed, the first condition is simply that the cookie environment to the 

right of the origin is the same as some cookie environment in Moreover, it will follow from 

Proposition 13.11 below that the second condition holds for rj-a.e. cookie environment uj G 

Proof. The proof is accomplished by a modification of the martingale argument leading to dU . For 
n > 1 we will modify the random walk process by only recording the times when the random walk 
is to the right of the origin. That is, any jumps to the left of the origin are replaced by a jump 
to wherever the walk then jumps back to the right of the origin. However, we make one further 
modification; if when the walk returns to the right of the origin it lands in [n, oo) then we make the 
walk land exactly at n. Note that the modification done in this way doesn’t change the local time 
of the sites x G [0, n) up until time t„. Secondly, any jumps to the left of the origin are replaced by 
a jump somewhere in [0, n] so that the expected displacement only increases. Thus, if we subtract 
the original drift (that is the expected displacement of the unmodified excited random walk) at all 
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the sites in [0, n) that are visited then we get a sub-martingale. To make this precise, let uq = 0 
and let Uk = inf{z > Uk-i : -Tj > 0} and for n > 1 fixed let be defined for A; > 1 by 



if Uk < Tn 

< Xr^ if Uk > Tn and > 0 

n if Ufc > Tn and < 0. 


Then, we claim that is a sub-martingale with respect to the filtration = 

(^{Xi, i < Uk)- Note that is constant for Uk > Tn- However, on the event {uk < Tn) G Xuf, we 
have 




M, 


(n) 


fc+1 






- M, 


(n) 


— Euj + l Xuf. 


) '^{uk+x=Uk+l} + {^Uk+l ^ ^ ^Uk 


) l{uA, + l>Ufc + l} \ ^Ul^ 


Eul [Xu^j^i Xu^ I Eui)\ 


> 0 , 


where the last inequality follows from the fact that on the event {uk+i > Uk + l) we have Xnf,+i < 
0 < ■ Since is a sub-martingale, ([7]) follows easily from optional stopping. □ 


3. Proof of Theorem 11.41 


The key to proving part (i) of Theorem 11.41 is the following Proposition. 


Proposition 3.1. Let Assumvtions iHlfD hold- Then P,;(lim sup„_^oQ = oo) = 1. 


Remark 3.2. Since we have assumed that our cookie environments have a non-negative drift at each 
step, it is natural to expect that lim sup„_^oo = oo. However, since we are allowing for possibly 
unbounded jumps we cannot conclude that this is the case for every cookie environment uj € ^- 

For instance, let u = {oJx,j{ ))x&'L,j>i be given by 

_ f i(5_i -I- ihi X > —1 or j > 2 

I (l — h_i -|- X < —2 and j = 1. 

(Here, 5x G Mi(Z) denotes the Dirac measure at x G Z.) Note that for this cookie environment uj, 
d{ujx,j) = 0 for all x G Z, j > 1 but 

P..(Xn = -n, Vn > 0) = - J] f 1 - ^ J = - > 0. 

k=2 ^ ' 

In contrast, if instead we had restricted ourselves to excited random walks with uniformly bounded 
jumps, then an easy adaptation of the proof of [ZerOGl Lemma 3] could be used to show that 
(lim sup„_^j,o = oo) = 1 for all cookie environments uj 


Proof- Clearly it is enough to show that P,,(rm = oo) = 0 for all m > 1, or equivalently 

(8) Puj{Tm = oo) = 0, Vm >1, for rj-a-e- cookie environment uj- 

For m > 1 fixed, define the random variables {sfc}fc>o and {S'fcjfc^o recursively by letting 

So = So = 0, and ^ <y 2 S,.,-m forfcPl. 

Sfc — Xsf_ , 

Note that these random variables have the following properties. 
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• If 5^ = > m for some k then Sj = for all j > k (and also Sj = Sk for all j > k). 

Therefore, Tm = hmfc_>.oo Sk almost surely. 

• USk = Xg^ < m, then is the exit time of the interval {2Sk — rn, m) and is the 
midpoint of this interval. 

• If S’*; < m, then Sk < m(I — 2^). 

Now, these properties imply that 

Puj (sfc < Tm) — Puj (sfc—1 ^ Sk ^ Tm) 
oo 

(9) = X] X] X] = n, Sk-l = X, ca(n) = w') (fT2x-m < Tm) . 

(There are uncountably many cookie environments uo' with oj' < oj. However, for n and x hxed 
there are only hnitely many uj' for with the hrst probability inside the sum is non-zero.) We will 
show below that 

(10) lim sup P*, (<T2a;-m < Tm) < I?-a.S. 

Postponing the proof of (jlOp for now, we note that this implies that for r/-a.e. cookie environment 
UJ there exists a ko = A:o(w) such that 

P*, {a2x-m < Tm) < Vw' < UJ, X < m(l - 2^°"^). 

Therefore, for any k > ko we can conclude from Q that Pw{sk < Tm) < |Pa;(sfc-i < Tm)- Iterating 
this we obtain that Puj{sk < Tm) < (3/4)^“^° for all k > ko, and thus 


Pui{Tm = oo) = lim Poj {Sk < Tm) = 0, TJ-a.S. 
k^oo 


To complete the proof of the hrst part of the Proposition it thus remains to prove (llUp . To this 
end, hrst note that since uj € random walk is a submartingale under the measure P*, for 

any uj' <uj and therefore 


® — Puj' \_^Tmf\(T2x-m\ 

Puj' \_^'''m'^{Tm<0-2x-m}\ PPuj' [^Cr2a:-m ^{t,ti >0'2a;-m}] 

< 2{x - m)P*,(o- 2 x-m < T,„) + m -k P*/ [(^r^A<72._^ “ "l). 


from which it follows that 

( 11 ) 


P^>{<T2x-m <Tm)<^ + 




(X 


TmJ\0-2 x — m 


-m) 


To bound the last expectation on the right, for any cookie environment uj we can expand the 
quenched measure P^; to contain an independent family of random variables {kPj/jIyez,i>i such 
that Wyj has distribution ujy^j for each y G Z and j > 1. The excited random walk can then be 
constructed by letting Wy^j be the jump that the walk makes upon the j-ih. visit to the site y. Now, 
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suppose that oj' = < uj. Then, 


K' 




_ TpX 

- 


m—1 


E EE {^TmAc72x-m ^ {Xk=y, Lk{y)=j, Tm/\(72x-m = k+l} 

y=2x—m+l j>l k=0 
m—1 Af—£(y) oo 

— ^Uj' \'^\Xk=y, Lk{y)=.i,TmA(T 2 x-m>k}] ^u)' \{^y,j + y ~ 

y=2x—m+l j=l k=0 

T ^^Ld' i.'km ^ ^2x—m ^ oo) 

m—1 M—l(y) 

< X] [{^y,3 +y- ^)+] + B 

y=2x—m-\-l j=l 
m—1 M 

^ E E^E(^i/u+2/-"^)+]+^- 

y=2x—m+l j=l 

where in the first inequality we used the fact that ujy ^ = ujy^£(^y^j_j = /r has support in [—B,B] for 
j + i{y) > M, and in the last inequality we used that lj' = a{uj,i) < uj. Applying this upper bound 
to ([TT]) we obtain that 

\ B 1 m—1 M 

{a 2 x-m <rm)<- + + 2{m-x) E E ^ " ”^)+] ' 

^ ^ ' y=2x—m-\-l j=l 

Note that this upper bound is uniform over all uj' < uj. Therefore, to complete the proof of (jlOp 
we need only to show that 

m—1 M 


( 12 ) 


(13) 


1 


lim 

x^-Qo 2{m — x) 

' ' y=2x—m+l j=l 


E E ^y~ "^)+] = 0 , ??-a.s. 


To this end, note that for any N >2 

^ m—1 M 

lim sup 


— -n E E +y- "i)+] 

^^_oo 2[m X) y^2x-m+l j=l 


< lim — - . 

x^-oo 2{m — x) I 


M 


m—N M m—1 M 

Y. E^"i(»'w-")+!+ E E^“ii»'»ji 

y=2x—m+l j=l y=m—N+l j=l 


E IE,, [(lTo,i - A^)+] , i?-a.s., 

i=i 


where the last equality follows from Birkhoff’s Ergodic Theorem. Since 5 = X^^i lErjl^Oj] < oo, 
this upper bound can be made arbitrarily small by taking N ^ oo. □ 

Lemma 3.3. Let Assumvtions T^W^ hold. Then 

P„ ( lim inf = —oo, lim sup = oo ) = Pj,(7^). 

V ^ ^CXD —Vrv~i } 
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Proof. Recall that B is the uniform bound on the jumps from distribution ^ as in Assumption iBl 
Consider the number of times that the random walk makes a jump from some site y > B to the 
left of the origin. By Assumption O and the fact that oj we can conclude that any such 

jump must have occured during the hrst M visits to y. Therefore, 


Er, 


1{a:„>b,x„+i<o} 

n>0 


~ ^ ^ ^ ^ ^ ^ — y-i Bn—l{y) — j, Xn+I < 0) 

n>0 j<M y>B 

— X!/ + 2/ < 0) 

j<M y>B 

= + y < 0) 

j<M y'>B 

= ^ E^ [{Woj + B)_] < oo, 

j<M 


where the last line is hnite by Assumption O Thus, if the random walk crosses the interval [0,R) 
infinitely many times then it must in fact visit that interval infinitely often. That is. 


( liminf A„ = —oo, 

y n—)-oo 


lim sup Xn = oo ) < P,) 

n^oo 


x- 

K n>0 


-{A'„g[0,B)} 


= OO 


For any site y € [0, R) and x G Z there is a path of hnite length starting at y and ending at x 
that occurs with positive probability under the random walk measure induced by /r. If the site y is 
visited inhnitely often, then this hnite path must be followed upon inhnitely many times. Thus, if 
the interval [0, R) is visited inhnitely many times then every site is visited inhnitely many times. 
Therefore, 


{ liminf = —oo, lim sup A„ = oo I < Pr; ^{X„=x} = oo, Vx G Z 

\ n—>-cx) n^oo ' ' ^^ " 

The reverse inequality is obvious. 


. n>0 


□ 


We are now ready to give the proof of the hrst main result of the paper. 

Proof of Theorem \1.4\ If any site x G Z is visited inhnitely many times then it follows from As¬ 
sumption E] that liminf„_,.oo X^ = —oo and limsup„_,.(^ Xn = oo. Thus, it follows from Proposition 
13.11 and Lemma [T3l that P^(7^ U 7+) = 1. This proves the hrst part of Theorem 11.41 
To prove the second part of Theorem 11.41 it is enough to show that <5 < 1 implies 

(14) P^{a-m = oo) = 0, Vm > 1, for y-a.e. cookie environment uj. 

The proof of ()14p is similar to the proof of ([8]) above and so we will only provide an outline here 
highlighting the differences from the proof of ([8]). To this end, hx an integer a > for m > 1 

hxed dehne the random variables {rk}k>o and {Rk}k>o by 

ro = Ro = 0, and Ra+l)R,_i+am A a-m ^ ^ 

y Rk — Xrf. 

These random variables play a similar role as Sk and Sk in the proof of ([5]) above, but now if 
Rk > —m then Rk is no longer the midpoint of the interval (—m, (a -|- l)Rk + am) but instead the 
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distance to the right endpoint is a times the distance to the left endpoint. As above, the key to the 
proof of (jl4h will be showing that 

(15) lim sup P^, {T(^a+l)x+am < CT-m) < + 5, P^.S. 

Note that our choice of a implies that 1/(1 + a) + (5 < 1. Therefore, (P^ implies that any p G 
+ (^51) and 77-a.e. cookie environment to 

P(jj {^k ^—m) — Puj ij'k—l ^ ^—va) 

00 

= X] X] C!' {pa+l)x+am < (^-m) , 

n=l x>m{l-\-a)^~^ —m 

^ pPcdi'^k—l ^—m): 

for all k sufficiently large (depending on ca). From this it follows that 

Pui{cr-m = 00 ) = lim Puj{rk < (J-m) = 0, r]-a.s. 

/c—)-oo 

To complete the proof of (fUl) we need to prove (fTSl) . As a first step in this direction, note that 
([H) implies that 

{a-\-l)x-\-am—l {a-\-l)x-\-am—l 


(16) 




X 


"!*( a +1) X + a m 


<xp d{ijj[)<x+ d{uji), 

and a lower bound for the same expectation is 


z=—m+1 


K' 


X. 




(17) > (a + l)(x + m)p^, {T(a+l)x+am < CT-m) - m - E^, + m)- 

Combining (fT6|) and (fT7|) we get 

^ {a-\-l)x-\-am,—l 

CJ' {Tia+l)x+am < (^-m) < ^ 


(a + l)(x + m) . ^ , 

^ ^ ^ ^ 2=—m+1 


(18) 


+ 


1 


-EE 


('^Ra+l)x + am^^ —m T Ul) 


(a + l)(x + m) 

Since the ergodic theorem implies that the second term on the right converges to Eri[d{u}Q)] = 5, 
rj-a.s., to complete the proof of (fT^ we need only to show that 

1 


(19) 


lim sup 


TpX 


(X 


"^(a + l)x + a.m 


Aa.m +m)- 


= 0 . 


[a + 1)(® + m) 

To this end, an argument similar to (|12p implies that 

(a-\-l)x+am—l M 

P(jJ^ ^^'^(a-\-l)x-\-CLrn^^—m P ^ E E Eu) \iWy,j + 2/ T xn)-\ + B, \fuj' < ui, 

y=-m+l j=l 

and from this (|19p follows from an argument similar to the proof of (1131) . □ 
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4. The cookie environment process 


Since the transitions of the excited random walk depend on the history of the walk, the excited 
random walk is not Markovian. Of course, by expanding the state space to include some infor¬ 
mation about the history of the walk one can obtain a Markov process. In this section we will 
introduce a Markov chain which we will call the cookie environment process that is reminiscent of 
the environment viewed from the particle that is used in random walks in random environments. 
This cookie environment process is similar to a process used by Zerner in |Zer06] in studying excited 
random walks on and on strips, and the main outline of this section follows that |Zer06] though 
the possibility of unbounded jumps introduces significant difficulties. 

To define the cookie environment process, let 0 : II —^ be the natural (spatial) left shift 

operator on cookie environments. That is, Oco = co' = {^'x j}xei,j>i is the cookie environment with 
j = cox+ij for all X £ Z, j > 1. We define the cookie environment process {Cn}n>o to be the 
stochastic process on H x Z_|_ defined by 

(20) Cn = (^"^(rn), Xr„ - n), Vn > 0. 

The first coordinate 0”cu(rn) records the cookie environment when the walk first enters [n, oo) and 
shifts the cookie environment n units to the left. The second coordinate — n records the 
distance which the excited random walk exceeds n when first entering [n, oo). Note that the cookie 
environment process Cn is only well defined for all n when limsup^^,^ X^ = +oo. Therefore, if we 
define T C 11 x Z_|_ by 


4 ' = 


|(w,x) GlIxZ+ : P- 


lim sup Xn 




it is easy to see that {Cn}n>o is a Markov chain on T. In the following lemma, we will show that Cn is 
in fact a weak Feller continuous Markov chain on 4/. However, before stating this a brief discussion 
is needed on the topology of the state space 4/. The space Mi(Z) of probability distributions on 
Z is equipped with the topology of weak-* convergence (convergence in distribution), and then 
the space H = Mi(Z)^^^+ of all cookie environments is given the corresponding product topology. 
Note that it is well known that this topology on H is compatible with a metric under which H is a 
Polish space. Finally, the space 4^ is given the induced subspace topology from H x Z_|_, where Z_|_ 
is of course given the discrete topology. 


Lemma 4.1. The cookie environment process {Cn}n>o « weak Feller continuous Markov chain 
on T. That is, if f : 4^ —>■ M is a bounded continuous function then the mapping {td,x) e-)- H^[/(Ci)] 
is a bounded continuous function from T —>■ M. 


Remark 4.2. The proof below is a minor adaptation of the proof of Lemma 5 in [Zer06] . 


Proof. Let (a;,x) G 4' be fixed and let {uj^'^\xn) be a sequence in 4/ with {uj^'^\xn) —>• (a;,x). Since 
Xn ^ X \n the discrete topology on Z_|_, without loss of generality we may assume that Xn = x for 
all n. If X > 1 then ri = 0 and so 




[/(Cl)] = fiOJ^Kx- 1) -^ fi9u,x- 1) = EZ[f (Cl)], Vx > 1. 


Thus, to complete the proof we need only to handle the case when x = 0; that is, we need to show 
that 


lim E 

n—>-cx) 


,iMfiCi)]=EMiCi)]- 


Since (a;,0) G 4^, we have that ri is finite Pt^-a.s., and so for any e > 0 there exists at = t{Ld,e) 
and L = L{uj,£) such that FL(ti < t, sup;i,<.,-j \Xk\ < L) > 1 — e. Let Ilt,L denote the set of paths 
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X = {xq,xi, ... ,Xm) of some length m < t such that xq = 0, —L < Xj < 0 for all i < m, and 
1 < Xm < L. With this notation we have that 


( 21 ) 


Ti < t, sup \Xk\ < L] = 

. k<Ti / 


E 

xeHt^i:, 


{X. follows the path x) . 


For each fixed path x G x,, the probability inside the sum on the right depends on the cookie 
environment uj only through {u}x,j{z)}\x\<L,\z\< 2 L,j<M the fixed probability measure /r. Since 
we have given the space of cookie environments 12 the product topology, it follows that 

(22) lim P^(n) {X. follows the path x) = P^j {X. follows the path x), Vx G Ht,L- 

Since the sum in (1211) is over the finite set n^x, we can thus conclude by the choice of t and L 
that Pi^{n) (ti < f, sup;j<^j |Xfc| < L) > 1 — e for all sufficiently large n. For any z = 1,2,..., L let 
nf_x d n^x be the subset of paths that ends at .Also, for any x — (xq, X]^, ..., x^^^) ^ lixT let 

£x : ^ ^ 2+ be given by £x(y) = Yl^=o ^{xk=y}- That is, £x is the local time of the random walk 
following the path x. With this notation, if x G 11^ and the walk X. follows the path x to begin 
then Cl = {6 a{u}, , z — 1). Therefore, 


— [/(Ci)1{ti<Xsupj,<,.j^ |Afe|<L}] T'tj[/(Cl)l{ri<t, supj,<^j^ |Afe|<L}] T ^^ll/llc 

P^(„){X. follows the path x.) f {6 i^), z — 1) 


< 


L 

E E 


z=l xGri: 


t,L 


— Pu]{X. follows the path x.) f {9 a{u!, i^.), z — 1) 


+ 2e||/||oo- 

The terms in the summation vanish as n —>■ oo due to ()22p and the fact that —> u; implies that 

6a{uj^'^\£x) —>■ 9a{uj,£x)- Therefore, as n ^ oo the above is at most 2e||/||oo- Since e > 0 was 
arbitrary this completes the proof of the lemma. □ 


Our main goal in this section is to establish the existence of a stationary measure vr for the cookie 
environment process. Since we have shown that the Cn is weak Feller continuous on T, a natural 
approach is to obtain vr as a (subsequential) limit of the sequence of measures fj,n on T defined by 

1 

(23) h'n(') = ~ iPr? iCk ^ ■)• 

k=l 

To this end, we will need the following tightness result. 

Lemma 4.3. If Assumptions HHD hold, then the sequence Hn defined in (I23p is a tight sequence 
of measures on T. 


Remark 4.4. If we restrict ourselves to cookie environments with uniformly bounded jumps, then 
the space of all cookie environments is compact and the tightness of the sequence {p^n} is immediate. 

Proof. We will break up the proof into three preliminary steps: 1) Finding “nice” compact subsets 
of 12, 2) Finding “nice” closed subsets of 'k, and 3) Controlling the second coordinate of Cx, X^-,, — k. 
Step 1: Nice compact subsets of f2 = Mi(Z)^^^+. 

We claim that for any e > 0 there exists a compact /C^ C 12 such that 

(24) ri{u G Xe) > 1 — 2e and uj € Xe uj' G X^, ^uj' < uj. 
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To prove this claim, first note that for any 5 > 0 there exists a compact subset Cs C Mi(Z) such 
that r/(uJo G C^) >1 — 6. This is possible since we have that ujqj = for all j > M and thus we 
need only to choose a compact Cs such that ^ G Cs and t]{u}oj G Cs) > 1 — 5/M forj = 1,2,. ..,M 
(this can be accomplished since Mi(Z) is a Polish space and every probability distribution on a 
Polish space is tight.) Now let 

^ € Z, j > 1} . 

Since /C^ is the product of compact sets, it follows from Tychonoff’s Theorem that fC^ is a compact 
subset of It is clear from the construction of /C^ that u G implies that u' G K-e for all 

uj' < CO, and also rj{cj ^ /Cg) < ~ This completes the proof of the claim in (fM)l . 

Step 2: Nice closed subset of T. 

A drawback to the compact subset fC^ constructed in step 1 above is that we cannot conclude 
that K-e X Z_|_ C 'k. Moreover, since ik is not a closed subset of 12 x Z_|_ we cannot conclude that 
(/Ce X [0, L]) n ik is a relatively compact subset of 'k. Therefore, we will show in this step that for 
any e > 0 there exists a closed subset C Cl with the following three properties. 

(25) ri{co G F^) >1 — e, co G Fi. uo' G \/uo' < co, and F^ x Z+ C 'k. 

First of all, it is easy to see that for any u < x < z that 

(26) P^(a„<T,)<^| 

is a relatively closed subset of 12. Indeed, if a; G 12 is such that P^{(Tu < Tz) > \ then there exists 
a t < oo and L < oo (depending on co, u, x and z) such that 

(27) P:(u„<(r,At), |A.J<L)>| 

Since the event inside the probability on the left concerns only finitely many possible paths, the 
probability on the left is easily seen to be a continuous function of finitely many of the coordinates 
iOyj(z) of the cookie environment co. Thus, there is a neighborhood of a; G 12 for which the inequality 
(1271) holds for all cookie environments in this neighborhood, and this is enough to show that the 
set in (1261) is closed. Since (1261) is closed it follows for k,m > 1 that 

■^k,m •— Cl 12 . P^i (<72x— m ^ An) ^ ^ 

= P) Pi G n : Pa[oj,£)i^‘^x-m < Tm) < “ 

is a closed subset of 12. (Note we are also using that the mapping co i-A a{Lo,i) is continuous 
for a fixed function £ : Z —)• Z+.) It follows from (1101) that limfc_),oo ??(w G = 1) and the 

paragraph following (fTOll shows that Puiijm < oo) = 1 for all co G Also, it follows clearly 

from the definition of A^^^ above that co G implies that oo' G A/^^^ for all co' < co. Therefore, 
if k(e, m) < oo is large enough so that 'niAk{e,m),m) > 1 - then = 0™=! ^k{e,m),m, is a closed 
subset of Cl such that 

T]{co G Hi;) > 1 — e CO G co' G H^, \/co' < co, and x {0} C T. 

Finally, if = {co : 9^co G Hs} then F^, = H^o is a closed subset of Cl with all 

the required properties. 
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Step 3: Control on Xr, - k. 

To obtain control on the second coordinate of the cookie environment process Cru we note that for 
any integer L > B and k > 1 that 

M 

Pr,(^r, -k>L)<Y.Y. + V-k>L) 

y<k i=i 

M oo M 

= E E > ^) = E [(^oj - LU] ■ 

j=li=L+l j=l 

Note that this upper bound does not depend on A: > 1 and can be made arbitrarily small by taking 
L sufficiently large. Thus, for any e > 0 there exists an Lg < oo such that 


(28) 


Fr^iXr^ - k > Le) < e, \/k> 1. 


Having completed the above three preliminary steps, we are now ready to prove the tightness 
claimed in the statement of the lemma. For e > 0, let /Cg, Tg and Lg be as in steps 1-3 above. 
Then, (/Cg D Tg) x [0, Lg] is a compact subset of T, and 

1 

liminf/i„ ((/Cg fl Fg) x [0, Lg]) = liminf - E^^ ^ ^ 

n—>-oo n—>-oo n 

k=l 


> 1 


lim sup — 

n—^oo ^ 


^ {p^ (^e^cj{Tk) ^ /Cg n Fg) + {Xr, 

k=l 


> 

> 

> 


1 — e — 

l — e — 
1-Ae. 


1 ^ ^ 

lim sup — r] (9^oj ^ /Cg fl Fg 
n-i>oo n 

{ri{u} ^ /Cg) + 7/ (w ^ Fg)} 


k > Ls 


)} 


where the second inequality follows from the properties of /Cg and Fg and the fact that 9^oj{Tk) < 
9^uj. Since e > 0 was arbitrary, this completes the proof of the lemma. □ 

Corollary 4.5. If Assumptions ITVFDI hold then there exists a stationary probability measure vr on 
T for the Markov chain with the following properties. 

(i) The environment to the right of the origin {cOx}x>o has the same distribution under vr as 
under the measure rj. Moreover, if {uj,Xq) has distribution vr then {uJx}x>o is independent 
of Xq and the environment to the left of the origin {u)x}x<q- 

(ii) ET^[d{ijjy)\ < 5 for all y G Z. 

Proof. It follows from Lemma 14.31 that the sequence of measures fj-n is tight, and thus there exists 
a subsequence Um such that converges to a measure vr on T. The fact that vr is necessarily a 
stationary distribution for the Markov chain follows from the fact that Cn is weakly Feller (see 
the proof of Theorem 12.0.l(i) in |MT93| ). 
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To prove the claimed properties of the stationary measure vr, let ^ C O be a measurable with 
respect to x < 0), i? C n be measurable with respect to x > 0), and y G Z_|_. Then 

1 ^ 

Hn{{A nB) X {y}) = - Pt? (o^ui{Tk) G An B, = k + y'^ 

k=l 

= GA,Xr,=k + y) G B) 

^ k=l 

= Hn{A X {y})y(w G B), 


where the second equality follows from the i.i.d. assumption for the law y on cookie environments. 
It follows from this that the claimed properties in (i) hold. 

For the second claimed property of vr, note that 


1 

^ k=i 


d{uk+y) - 


1 

< - 
n 


n 

E 

k=l 


— 5 . 


Therefore, to conclude that ET^[d{iOy)] < 6 we need only to show uniform integrability of d{u}y) 
under the sequence of measures For any L < oo 


1 ” 

Eyn [di‘^y)^{diujy)>L}] = {d{uk+y) - D^'^y^ '^{d{uj^+y)-D’^+'/>L} 


k=l 


1 J A 
k=l 


Ey[d{uio)l{d^^^)>L}]- 


Note that this upper bound is uniform over n and can be made arbitrarily small by taking L oo. 
This proves the required uniform integrability. □ 


For the remainder of the paper, we will often consider an excited random walk where both the 
cookie environment u and the starting location Xq are random. If the joint distribution of {oj, Xq) is 
given by some measure a on x Z then in a slight abuse of notation we will use Pa(-) = 
to denote the averaged distribution of this walk. Corresponding expectations will be denoted 
In particular, will denote the law of the excited random walk when (cj,Xo) are chosen from 
the stationary measure tt from Corollary 14.51 We close this section with a result concerning the 
behavior of the excited random walk under this measure. 


Lemma 4.6. If vr is an invariant probability measure for C,n os given in Corollary \4-5\ then 
< 1, where = hm„_>.oo is the total drift ever consumed by the walk at the ori¬ 
gin. 

Proof. Recalling ([7|), for any (w,x) G T and 0 < x < n we obtain that 

EZlDtJ <n + EZ [(X,„ - n)l{x.„_i>o}] 

M n—\ 

<n + B + '^'^E^ [{Wy^j + y - n)+], 

j = l y=0 
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where the last inequality follows from an argument similar to that of (jl2p . Then, averaging both 
sides of the above inequality with respect to the measure vr on {uj, x) we obtain that 

M n—1 

EAK] <n + B + Y,Y.^v iiWyj + y - n)+] 

j=l y=0 
M n 

= n + B + J2Y.^v[iWoj-k)+] 

j=i k=i 

= n + o(n), 

where in the first inequality we used also that the environment has the same distribution to the 
right of the origin under vr as under the original measure rj, and the last equality follows from the 
fact that E^[(lToj — k)+] —>■ 0 as A: ^ oo. 

Next, for 1 < A: < n we have that Since tt is a stationary measure for the 

cookie environment process it follows that we have that for all x > 0 and 

A: > 1, and thus 

(29) (n - A: + < E^ [T>+] < n + o{n). 

Dividing by n, letting n ^ oo and then letting A: —> oo we obtain that 



□ 

5. A ZERO-ONE LAW 

We showed under minimal assumptions in Theorem that V’^iTZ U 7+) = 1. That is, the 

excited random walk is always either recurrent or transient to the right. In this section, we will 
show that with the addition of Assumptions [Pl and lEl that we can prove the following stronger 0-1 
law for recurrence and transience. We will prove the 0-1 law under both the measures and Ptt- 

Proposition 5.1. Let Assumptions [AHEI hold. Then, ¥rf{T+) = 1 — ¥^{71) € {0,1} and Ft^{T+) = 
1 — Ft^{TZ) G {0,1}, where vr is the stationary measure for the cookie environment process from 
Corollary \4-5\ 

Remark 5.2. It should be noted that the proof of the corresponding 0-1 law for nearest neighbor 
excited random walks is significantly easier. In fact, if we assume a strong form of “uniform 
ellipticity” then many of the technical difficulties in this section may be avoided. In particular, the 
proof of the 0-1 law for excited random walks in |Zer06[ Lemma 9 and Proposition 10] can be used 
if we assume that there exist constants c, C > 0 such that cfi{z) < ujx,j{z) < Cfi{z) for all x € E 
and j > 1. 

To prepare for the proof of Proposition 15.11 we begin by noting that Assumption [B] implies that 
there exists an integer Kq > B such that for any K > Kq the simple random walk with jump 
distribution /.i is irreducible restricted to [0, K —1], That is, for K > Kq and x,y € [0, A — 1] there 
exists a finite path z = {zq, zi,..., Zm) beginning at zq = x, ending at Zm = y, with z^ G [0, A — 1] 
and p,{zk — Zk-i) > 0 for A; = 1, 2,... , m. 

Secondly, there exists an integer Ai > B such that for any A > Ai we have 



M 0 


M K 

Cj^ Erj 

n ‘^ 07 ( 2 ) 

> 0 and c'^ := Er^ 

n 


J=1 z=-K 


_j=l z=0 
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Note that Cj^ and are the probability that on the first M visits to a fixed site all jumps are in 
[—K,0] or [0, iii], respectively. 

Lemma 5.3. Let Assumvtionshold. Then, for any K > maxl/Co) Ki} 

(30) {t2k < CT-I, ^r 2 K = Lr.^j^{x) > M, Vx G [K, 2K -1]) > Q. 


Proof. Let K > maxjii'o) ^i} be fixed, and for each i = 0,1, 2,... , if — 1 let 




( i ) = .,(0 


0 )^ 1 ) 


5 ^rrii) 


be a path of finite length such that 

• //(x^b) := ~ ^i-i) > b. That is, the path has positive probability for the 

simple random walk with jump distribution /r. 

• The path x^b begins at Xq ^ = i and ends at Xml = K. 

• x^*^ G [0,if — 1] for all k < m*, and Ir (i)_ i > 1 for all x G [0,if — 1]. That is, 

the path stays inside of [0, if — 1] up until the last step and the path visits every site in 
[0, if — 1] at least once. 

Now, we explain a strategy to force the event in the probability in (l30]l to occur. 

(i) When the random walk reaches a site x G [0, if — 1] 

(a) if there remains at least one cookie then the walk jumps to a site in [x, x + if], 

(b) and if there are no cookies remaining then the walk jumps to a site in [x + 1, x + iij. 

(ii) If the random walk is at a site x = if + i G [if, 2if — 1] with no cookies remaining, then 

the the walk begins following the path if + xb) until it either (a) reaches a site with at 

least one cookie remaining, or (b) reaches 2if (in which case there must have been no 
cookies remaining in [if, 2if — 1] since the path visits every site in [if, 2if — 1]). 

(iii) Whenever the random walk reaches a site x G [if, 2if — 1] with at least one cookie 
remaining, then the following step of the excited random walk is in [x — if, xj. 

Note that in this procedure, each time the random walk attempts to follow the path if + x^) as in 
the third step outlined above, the walk either succeeds in following the entire path or one cookie 
is removed from the interval [if, 2if — 1]. Therefore, at least one of the first Mif such attempts 
must succeed. This also limits the number of visits that the walk has at each site in [0, if — 1] by 
time T 2 k- From the above outlined strategy we obtain that 


P 77 {t 2 K < ( 7 - 1 , ifrax = 2if, Lr^j^{x) > M, Vx G [if, 2 if - 1 ]) 


^K-i 


MK 


> 




. 1=0 


□ 


As a corollary of the above lemma, we get that almost surely at some point the random walk 
will reach a new maximum and at that time have visited all if of the sites immediately to the left 
at least M times (so that no cookies remain in the if sites immediately to the left and none of the 
sites to the right have been visited yet). 

Corollary 5.4. Let A,ssumptions\A\fM hold. For any if > max{ifo,ifi} 

P^ (3n < oo : Xr^ = n and Lr^{x) > M, Vx G [n — if,n — 1]) = 1. 

Moreover, the same result holds for the measure P^r. 
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Proof. For K > max{KQ, Ki} fixed, define a sequence of stopping times {tk}k>o by 
to = 0 and tk+i = mi{n > tk : Xn > Xt,^ + 2K} = TXt^^+ 2 K, 
and let {Ek}k>o be the sequence of events 

Ek = {^ 4+1 = + 2i^ and Lt^^.ix) > M, Vx G [Xt, + K,Xt, + 2K - 1]} . 

If we let ek > 0 he the probability in ()30p . then it follows that 

Fjj (Ek \(T(Xi, i < tk)) > eR > 0, VA: > 1, 

since conditioned on a{Xi, i < tk) the cookie environment to the right of Xt^. is i.i.d. with the same 
distribution as the original distribution on cookie environments to the right of the origin. From 
this we can conclude that 

( U Ek] >1-(1-£k)". 

\k=0 J 

Taking n —>■ oo we see that P,, (U^o Ek) = 1- 

The same proof works for the measure Ptt since the cookie environment is also i.i.d. to the right 
of the origin under the stationary measure tt. □ 


For the following lemma, we introduce the notation Cj{I) = Q:(a;, Ml/(-)) to denote the cookie 
environment oj with all cookies removed from the set / C Z. Also, let 


Bq = inf > 0 : r/ ^ ojxj(z) = OVx G Z,j > ij ~ ^ j ’ 


be the uniform upper bound on the maximum jump size of the excited random walk. Note that it 
may be the case that Bq = oo. However, in the case of uniformly bounded above jumps (Bq < oo) 
we can prove the following. 


Lemma 5.5. If Bq < oo and L > K > max{Ho, ATo} then then 

(31) P^(^i_K-i]){T+n{a-L = oo}) > 0 n {<t_l = oo}) > 0. 

Proof. If the probability on the left side of (|3ip is positive, then there exists a finite path x = 
(xo, xi,..., Xm) starting at xq = 0 which stays in {—L, oo) and ends at Xm > 0 such that 

(32) P^([-K-1]) = X, >0^ >0. 

Now the path x may no longer have positive probability in the cookie environment (h([—L,—1]). 
However, since K > Bq any excursion to the left of the origin must exit the negative half-line 
from a site in [—Bq, —1] C [—K, —I], and since L > K > Kq then every excursion in the path x 
to the left of the origin can be replaced by an excursion that stays in (—L, — 1], only uses jumps 
supported by the distribution /r and exits the negative half-line in the same manner as the original 
excursion. Therefore, there exists a path y = (yQ,yi,... ,yi) that has positive probability in the 
cookie environment co{[—L, —1]), ends at yi = Xm and which also has the same number of visits to 
all sites right of the origin. From this we see that (j32p implies that 

_i]) (^[o,£] = y, inf >0^ >0. 

Clearly, this implies that the probability on the right side of (13Ih is also positive. □ 

Lemma 5.6. Let V = {X^ > Xq, Vn > 0} be the event that the excited random walk never goes to 
the left of its initial location. If Assumptions hold and P,j(7+) > 0, then Fn(T+ CiV) > 0. 
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Remark 5.7. As noted in the proof of Proposition 13.11 due to Assumption [Al if the excited random 
walk stays non-negative then it necessarily is transient to the right. That is IPr;(7+ H "P) = Pr;(P). 


Proof. We divide the proof into two cases, depending on whether the jumps are uniformly bounded 
above or not. 

Case I: Unbounded jumps (Bq = oo). If the event 7+ occurs, then at some point the walk is 
always to the right of the origin. Therefore, there exists a hnite path x = (xo,xi,... ,Xm) with 
xq = 0 and Xm > 0 such that 


(33) ( Afc = Xk, k <m, and inf > 0 ) >0. 

y k>m J 

Let L < oo be such that the finite path x is contained in {—L, oo). Since the jumps are unbounded, 
there exists a j < M such that > 0) > 0. It follows from Lemma [51^ above that 

for K > maxKo, Ki there exists a path y = (?/o, Vi, ■ ■ ■, Vi) starting at yo = 0 with € [0, 2K] for 
k < i and ending at yi > 2K + L with Pr,(Afc = yk, Vk < i) > 0. Indeed, after forcing the event 
in Lemma 15.31 to occur, with positive probability the random walk then performs j — 1 loops from 
2K back to 2K and contained in [K, 2K] and then on the j-th visit to 2K jumps at least L to the 
right. Then, by appending the path y to the beginning of the path x and using the assumption 
that the cookie environment is i.i.d. (Assumption |D|) we get that 


^ ^ and inf > yi 

yi + Xk-i (. < k < I + m, k>£+m 


P^(P n r+) > p^ = 

= Frj{Xk = yk, yk < £)Frj ( Xk = Xk, k <m, and inf Xk > 0 ) >0. 


k>m 


Case II: Uniformly bounded jumps {Bq < oo). For AT < oo let px be a stopping time defined 
by 

Pk = inf {xn '■ = n and Lt^{x) > M, Vx € [n — AT,n — 1]} . 

Note that Lemma 15.41 implies that F^^^px < oo) = 1 for any AT > maxlATo, ATi}. Therefore, if 
Pr;(7+) > 0 then there exists an A > AT such that 


P^ 



inf Xk > Xp^ 

k>pK 



and then it follows from Lemma 15.51 that 


> 0 , 


(34) 



inf Xk 

k>pL 


>X, 


Pl 



> 0 . 


Thus, the excited random walk with all cookies removed from [—A,—1] never reaches —A with 
positive probability. Since Lemma [5.31 implies that with positive probability there is a non-negative 
path that ends at = 2A with all cookies used in [A,2A — 1], we can thus conclude that after 
this happens there is then a positive probability of never going back below A and thus Fp{'PriT+) > 


0 . 


□ 


A corollary of the above lemma is that the same result holds for the measure P^r- 

Corollary 5.8. Let Assumvtions HHAI hold. If tt is the stationary measure for the cookie environ¬ 
ment process from Corollary \4.5\ and Ft^{T+) > 0, then P7r(7+ n "P) > 0. 

Proof. Since vr and p have the same distribution on {uJx}x>o, then Frj{T+ DP) = P7r(7+ nP). Thus, 
by Lemma [5161 it is enough to show that P7r(7+) < Frj{T+). 
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For two cookie environments let be the cookie environment which agrees with u to the 

left of the origin and to' to the right of the origin. That is, = uJx,j'^{x<o} For 

(w, x) G T define 

R{oj,x) = I 

Thus R{oj, x) is the probability the walk started at x is transient to the right conditioned on 
the realization of the cookie environment to the left of the origin. We claim that the mapping 
(w,x) —>■ R{u!,x) is lower semi-continuous. To see this, note that if the walk is transient to the 
right then there is a last visit to the negative integers by the walk. Therefore, if Hx denotes the 
collection of paths x = (xq, xi,... , Xm) of finite length with xq = x, Xm-i < 0 and Xm > 0 , then 


(35) 


R{u:,x) = > 0, Vn > 0) ^ f -P(* (x/, = Xk, k < m, ^^^Xk > r]{du}'). 

xgh,, '' 


For each fixed path x G flj,, the probabilities inside the integral on the right only depend on 
finitely many of the coordinates Uyj from the cookie environment uj and thus it is easy to see that 
the mapping cj i-A / {Xk = Xfc, k < m, inik^mXk > 1 ) r]{du}') is continuous for any hxed 

X G IIj;. Then it follows from (1351) that R{uj,x) is lower semi-continuous, and since the measure vr 
was constructed as the weak limit of the measures we can thus conclude that 

(36) P 7 r(Tf) = [i?(w,Xo)] < liminf [i?(w,Xo)] . 


However, for any n > 1 


[R{u,Xo)] = 


1 ^ 


n 


/ 


k=l 
1 " 


n 


/ 

k=l 


R{e’^Ld{Tk),Xr,-k) 

{T+ I (t{oJx, Xi : X < k, i < Tk)] 


(37) =Fr,(r+). 

Therefore, it follows from (l36|) and (l37)l that ^,^(7+) < P^(7+). 

We are now ready to give the proof of the main result of this section. 


□ 


Proof of Provosition \5.1\ Let /3 = Pr;('P) = Pr,(P n 7+). If P,,(7+) > 0, then Lemma implies 
that /3 > 0. The proof of the proposition will be hnished by showing that /3 > 0 in turn implies 
that P^(7+) = 1. To this end, let 0 = A^o < < ^2 < -^2 < -H 3 < ... be a sequence of 

stopping times for the random walk defined as follows. 


(38) Bj = inf{n > Nj^i : X^ < and 


Nj = inf 


n > Bj : Xn > max Xk 


J > 1- 


(We will use the convention that Bj = 00 implies that Nk = Bk = 00 for all k > j.) Since 
Pr,(lim sup„_^oo = -|-oo) = 1, we can conclude that 

(39) Pt;(A(j' < oo| Bj < 00 ) = 1, j > 1. 

Also, at a stopping time Nj-i the random walk is at a new maximum and so the environment to 
the right of the current location again has the same distribution as the environment to the right of 
the origin under the measure rj. Thus, 

(40) Pr)(Hj = 00 1 Nj-i < 00 ) = /3, 


i>i. 
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From these two facts we can conclude that < oo) = (1 — for all j > 1. Therefore, if 

/3 > 0 it follows that Bj = oo for some j > 1 almost surely, and thus that lim inf„_>.oo Xn > 0 with 
probability 1. From Theorem II. ^(i)| we can conclude that (3 > 0 implies that P^(Tf) = 1. 

To prove the conclusion of the Proposition for Pt^, we first need to show that 

(41) p^(r+) = l-p.(7^) 

To this end, first note that since Pj^ (lim sup„_,.oo= oo) = 1 it follows that 

Ptt film inf Xn < oo') = 1 — ¥-,^{T+). 

Since the cookie environment to the right of the origin has the same distribution under tt and r], 
the same argument in the proof of Lemma 13.31 shows that 

P^ < OO^ = p.,r I ^ = OO, Vx > 0 

That is, if the walk is not transient to the right under the measure P^r then the walk visits every site 
to the right of the origin inhnitely often. Finally, note that since ■= x {p}^) is a 

closed subset of 140 it follows from Assumption [Al that the stationary distribution vr is concentrated 
on X ^+- For all cookie environments in h is easy to see that if any site is visited inhnitely 
often then all sites are visited inhnitely often. This completes the proof of ()41l) . 

Having proved gu, it follows from Corollary 15.81 we need only to show that /3 > 0 implies 
P7r(7+) = 1. Since (p^ and (HOl) also hold for the measure Pj^, the same argument as above shows 
that /3 > 0 implies P^r(liminf„_).oo > 0) = 1 which by ()4ip implies that P7r(7+) = 1. □ 

6. A SHARP CRITERION FOR RECURRENCE/tRANSIENCE 

In this section we give the proof of the sharp criterion for recurrence/transience from Theorem 
11.61 As a hrst step we prove the following lemma. 

Lemma 6.1. //P.n-(7+) = 1, then E.n-[Z1^] = 1. 

Proof. Since Lemma ST] implies that E.n-[L)^] < 1, we only need to show that > 1. First 

of all, note that for any n, m > 1 and —m < x < n that 

— 1 n—1 

>nPfiTn<a.m)- d{uy)-Y,Km- 

y=—m-\-l y=0 

Taking expectations of (w, x) with respect to the stationary measure tt we obtain that 
nP,r(Tn < <0-m) < E7r[Xol{Xo<n}] + {m - 1)5 + nE^[D'^]. 

Therefore, dividing by n and letting n —>■ oo with m hxed we can conclude that 

P^(o-_m = oo) = lim P 7 r(Tn < a_m) < E^[D^]. 

n—^oo 

Since we are assuming that = 1, then limm->.oo Ptt(< 7-m = oo) = 1. □ 

Next, we prove that the criterion for recurrence/transience holds for the stationary measure Pt^ 
in place of P,,. 

^Note that differs from ^ in that we no longer require the first M cookies at each site to have non-negative 

drift. 
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Proposition 6.2. Let Assumptions [2H3 hold, and let vr be the stationary measure for the cookie 
environment process from Corollary \4.51 

(i) If 6 > 1 then F.,^{T+) = 1. 

(ii) If S < 1 then P 7 r( 7 ^) = 1. 


Proof. It follows from Proposition 15.11 that either P^(7^) = 1 or P 7 r( 7 +) = 1. First, assume that 
P 7 r( 7 ?.) = 1. Since the random walk then visits the origin infinitely often, we can conclude that 
= E 7 r[(i(wo)] = E^[(J(ti;o)] = 5- Therefore, it follows from Lemma US] that P 7 r( 7 ^) = 1 implies 

5 < 1 . 

Conversely, assume that P 7 r( 7 +) = 1- Then, Lemma 16.11 implies that 6 > E 7 r[L)^] = 1. To 
improve this weak inequality to a strict inequality we need to consider two cases. 

Case I: P 7 r(Xo > 0) > 0. In this case, 

F^{Xn > 0, Vn > 0) > K [P^°{V n r+)l{Xo>o}] = <^0 > 0)Fr,iV D T+) > 0, 
from which it follows that 6 = E 7 r[(J(ti;o)] > = 1. 

Case II: P 7 r(Xo = 0) = 1. In this case it must be that the first cookie cannot induce a jump to 
the right larger than 1, and since Assumption lEl implies that there is always a positive probability 
of a nonpositive jump on the hrst visit to a site we can conclude that Fl^[d(a;o,i)] < 1 = E 7 r[D^] < 
E^[d(a;o)]- We may thus conclude that 7/(d(a;o,i) < d{ujo)) > 0, and thus 


P^(D^ < d(cvo)) > Ptt (d(cJo,i) < d(ujo), = 0 , inf > 1 




n>l 


= Erj 

> 0 , 




where the last equality follows from Lemma 15.61 and the fact that wo,i(l) > 0 due to Assumption 
lEl It then follows that 1 = E.n-[L)^] < E 7 r[d(a;o)] = d. □ 

We conclude by giving the proof of Theorem 11.61 which follows easily from Proposition 16.21 and 
the results from Section [H 


Proof. Due to Theorem I l.^li)| and Proposition 15.11 we need only to show that Pr;(7+) 


5 > 1 . 


5 > 1 ^ p.(r+) = 1 

F^{vnr+) > 0 
p^(p n Ti.) > 0 

^ Frjin) = 1 . 


(Proposition 16.2p 

fCorollary 15.81 and Proposition 15.11) 

(Corollary 14. ^FI)] ) 

(Lemma 15.61 and Proposition 15.11) 

□ 
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